The Melbourne Team at the TREC 2010 Legal Track
نویسندگان
چکیده
The Melbourne team was a collaboration between academic and industry groups. The team participated in both the learning and the interactive tasks of this year’s Legal Track. The baseline run for the learning track employed true-relevance feedback, achieving respectable outcomes; the experimental runs added additional features and employed an SVM classifier, with poor results. The techniques developed for the learning task were then deployed in the interactive task. The classifier again achieved poor predictive quality, although final results place our production (non-significantly) first. We describe the learning task efforts in Section 2, and the interactive task in Section 3.
منابع مشابه
Melboune at the TREC 2011 Legal Track
The Melbourne team was a collaboration of the University of Melbourne, RMIT University, and the Victorian Society for Computers and the Law. The approach taken was to train a support vector machine based upon textual features using active learning. Two sources of relevance annotations were used for different runs: the official annotations, provided by the topic authorities; and annotations prov...
متن کاملOverview of the TREC 2010 Legal Track Notebook Draft 2010 . 10 . 25
The TREC 2010 Legal Track consisted of two distinct tasks: the learning task, in which participants were required to estimate the probability of relevance for each document, and the interactive task, in which participants were required to identify all relevant documents using a human-in-the-loop process. 2010 is the fth year of the legal track, the third year of the interactive task within the ...
متن کاملThe Role of Anchor Text in ClueWeb09 Retrieval
This report describes the work done at The University of Melbourne with the ClueWeb09 data corpus for the Web Track of TREC-2009 and TREC-2010, and for the Session Track of TREC-2010. We found that the impact-based retrieval model works well for the corpus, and that, along with some other factors, the use of an anchor text collection significantly boosts the retrieval effectiveness.
متن کاملSome Lessons Learned To Date from the TREC Legal Track ( 2006 - 2009 )
For four years now, the Text Retrieval Conference (TREC) Legal Track administered by the US National Institute of Standards (NIST) has untaken yearly studies evaluating the application of Information Retrieval (IR) methods to e-discovery in the context of U.S. civil litigation. In this short paper, we distill some of what has been learned. As we write this, analysis is not yet complete for some...
متن کاملA Model for Understanding Collaborative Information Behavior in E-Discovery
The University of Pittsburgh team participated in the interactive task of Legal Track in TREC 2009. We designed an experiment to investigate into the collaborative information behavior (CIB) of the group of people working on e-discovery tasks provided by Legal Track in TREC 2009. Through the studies, we proposed a model for understanding CIB in e-discovery.
متن کامل